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Abstract 

We study the effect of atom-molecule internal tunneling on the ground state of atom-molecule 
Bose-Einstein condensates in a double-well potential. In the absence of internal tunneling between 
atomic and molecular states, the ground state is symmetric, which has equal-particle populations 
in two wells. From the linear stability analysis, we show that the symmetric stationary state 
becomes dynamically unstable at a certain value of the atom-molecule internal tunneling strength. 
Above the critical value of the internal tunneling strength, the ground state bifurcates to the 
particle-localized ground states. The origin of this transition can be attributed to the effective 
attractive inter-atomic interaction induced by the atom-molecule internal tunneling. This effective 
interaction is similar to that familiar in the context of BCS-BEC crossover in a Fermi gas with 
Feshbach resonance. Furthermore, we point out the possibility of reentrant transition in the case 
of the large detuning between the atomic and molecular states. 

PACS numbers: Valid PACS appear here 
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I. INTRODUCTION 



Bose-Einstein condensation in dilute atomic gases has been offering opportunities to 
research macroscopic quantum phenomena, since its experimental realization in 1995. In 
particular, one of the most fascinating macroscopic quantum phenomena is the Josephson 
effect between two Bose-Einstein condensates(BECs) trapped in a double-well potential. 
This system is called as a Boson Josephson Junction(BJJ) l|. Recently BJJ has been realized 

2|. This experimental 
3|-|5|. Though in BJJ the spatial 
coherence of BECs is focussed, Josephson effects occur not only between spatial separated 
BECs but also between internal degrees of freedom in a single BEC. In particular, Josephson- 



experimentally, and macroscopic wavefunctions are observed directly 
achievement has triggered many interesting researches 



like effects between atomic and molecular states have been discussed theoretically 



In the last decade many efforts have been devoted to creating molecular BECs from ultra- 



cold atoms 



13| . Already molecular BECs have been created from fermionic atoms using 



magnetic Feshbach resonances 



On the other hand, the creation of coexisting atomic and 



molecular condensates by means of photoassociation has been discussed theoretically 
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16|. Photoassociation permits precise control of population transfer between individual 



discrete quantum states 



17l | . Currently, a mixture of a Rb BEC and a degenerate gas of Rb2 



ground-state molecules has been realized using photoassociation 13|. Furthermore, though 
not in Bose-Einstein condensed phase, the collective oscillation^ the populations between 
an atomic state and a molecular state has been observed 
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19| . The realization of 



atom-molecule BECs is forthcoming, and these experimental achievements have accelerated 



many theoretical researches about atom-molecule coherence 
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25|]. In particular it is dis- 



cussed that the atom-molecule internal tunneling changes the nature of system drastically. 
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For instance it is predicted that atom-molecn 
ground state in atom-molecule BEC mixtures 



e internal tunneling can induce a droplet-like 



6| . The relation between the 



the phase transition of bosonic atom-molecule mixtures is also discussed 



sing model and 
. As for 



26 



28 



atom-molecule mixtures in optical lattices, the possibility of so-called "super-Mott" phase 



is pointed out 
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30| 



In this paper, we study atom-molecule BECs in a double-well potential by focusing on 



the effect of atom-molecule internal tunne 
have discussed BJ J of binary mixtures 



ing on the ground state. Although several authors 



3lN34l|. effects of internal degrees of freedom in BECs 
in a double-well potential have not been fully discussed. In the present paper, we consider 
the atom-molecule internal tunneling. Even in a single-component BJJ, the competition be- 
tween strengths of tunneling and interaction causes various phenomena such as macroscopic 
quantum self-trapping(MQST) l|. Adding an atom- molecule internal tunneling as a new 
degree of freedom, we will show that the competition between the atom-molecule internal 
tunneling and inter-well tunneling or interaction leads to new phenomena. 

As our main result, we will show that atom-molecule internal tunneling induces the 
asymmetric ground state, which has non-equal particle populations in two wells. In the 
absence of internal tunneling, the ground state is symmetric, with equal particle populations 
in two wells. We note that ground states breaking the symmetry of trapping potentials 
have been found in various BEC systems. The well-known example of a symmetry-breaking 



ground state is a soliton in a quasi-one-dimensional attractive BEC 
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36| . The ground state 



in attractive BJJ also breaks the left-right symmetry of the double-well potential above 



37|. The asymmetric 



certain value of the interaction strength as predicted theoretically 
ground states in the above systems are caused by attractive interactions. In contrast we will 
show that, even for repulsively interacting Bose gasses, spontaneous symmetry breaking in 



the ground state emerges in atom-molecule BECs in a double-well potential owing to the 
atom-molecule internal tunneling. 

In addition, we show in the simplest case that the effect of atom-molecule internal tun- 
neling can be described in terms of the effective inter-atomic attractive interaction. This 
effective interaction is similar to that familiar in the context of BCS-BEC crossover in a 



Fermi gas with Feshbach resonance [38| . We show that this effective interaction is always 
attractive and induces the asymmetric ground states in the absence of the molecular tunnel- 
ing, the inter-molecule interaction and the inter atom-molecule interaction. Furthermore, we 
discuss the possibility of the reentrant transition, which cannot be explained by the simple 
form of the effective attractive interaction. 

This paper is organized as follows. In Sec. [ITl we explain the model and approximations, 
used in this paper. In Sec. Ill At we introduce a four-mode model and classical analysis. In 
the four-mode model, we concentrate on condensate modes only and ignore other modes. 
Furthermore, we ignore quantum fluctuations by replacing creation-annihilation operators 
in Hamiltonian by c- number. Next, the parameters in this model are estimated from exper- 
iments. 

In order to investigate the ground state, we first derive time-evolution equations in Sec. 
IIIBi Second, by using these equations, we derive the equations for the particle populations 
in the ground states in Sec. Ill Ct and we develop the expression for eigen frequencies in Sec. 
KDl 

In Sec. Illlt we perform the linear stability analysis, using the equations derived in Sec |Tll 
In particular, we investigate the stability of symmetric stationary states, where the particle 
numbers in the left and right wells are equal. By performing the linear stability analysis, we 
show that the atom-molecule tunneling induces the dynamical instability of the symmetric 



stationary state, which is the ground state in the absence of the atom-molecule tunneling. 
This indicates the emergence of the symmetry breaking ground states, where the particles 
localize in one well. In Sec. Illl A[ by using the equations for the particle populations 
in the ground state derived in Sec. Ill C[ we show this instability is accompanied with the 
bifurcation of symmetric stationary states to asymmetric ones. By comparing the energies of 
symmetric and asymmetric states, we confirm that the asymmetry state is the ground state. 
The general relation between dynamical instability and phase transition of ground states is 
discussed briefly in appendix \M Some details of the calculations are given in Appendices |B] 



II. MODEL AND APPROXIMATIONS 

A. Four-mode model and classical analysis 

The second-quantized Hamiltonian for Bose atoms and molecules can be written as 



where and represent field operators for Bose atoms and molecules respectively, A is the 
internal tunneling strength between atomic and molecular states, S is the energy difference 
between atoms and molecules, and V^xt(r) is a double- well potential. The inter-atomic, the 
inter-molecule, and the atom-molecule interactions can be approximated in terms of the 
s-wave scattering lengths as Qi = ATrh'^asi/mi, Qab = Qnh^agab/fnaii = a,b,mb = 2ma). Here, 



-E 




i=a,b 




(1) 
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nia is the mass of a Bose atom. Furthermore, we introduce the four-mode approximation. 
In this approximation, we concentrate on condensate modes only, and ignore the effect 
of the particles occupying other modes. From this point of view, field operators can be 
approximated as 4/a ~ ^aLaL+^aRaR, "^b - ^bLh+^bRbR, where ^aL, ^aRi^bL, ^bR) are the 
wavefunctions of the atomic (molecular) condensate modes in the left well and the right well 
respectively, cil, ai?(feL, &r) are annihilation operators for the atomic (molecular) condensate 
modes in the left well and the right well respectively. Applying these approximations to 
Eq.(l), we obtain the quantum four- mode Hamiltonian (four- mode model). 

H = -Ja{a{aR + a^jai) - Jbib^L^R + + ^{b{bL + 

+Uab {a[aLb[bL + o^^aRh^^hR) - g {h^aiaL + b^RaRUR + a[a[bL + a^^aj^^i^) , (2) 

where the parameters are defined in Appendix [Bl In addition, we use classical analysis, 
in which annihilation operators are replaced by c-number y/Ne^^, where is the particle 
number of a condensate mode and 6 is its phase. This approximation is justified when an 
occupation number is macroscopic. Using this procedure, we obtain the classical four-mode 
Hamiltonian as 

Hcl = -2Ja\/ NaLNaR C0s{9aR - 6^1) - 2, h y/J^hJ^ COS {9 b R - Obi) + A{NbL + NbR) 
+ Y(^!l + N!r) + ^{N^L + N^r) + Uab{NaLNbL + N^RNbR) 

-2g[NaLVN^LCOs{2daL - ObL) + NaR^/l^ COs{29aR " ^fcij)] , (3) 
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where NaL{aR) represents the particle number of the atom in the left (right) well, and A^bL(;,_R) 
does that of the molecule in the left (right) well. 6aL{aR) is the phase of the atomic condensate 
in the left (right) well, and 6bL{bR) is the phase of the molecular condensate in the left (right) 
well. 

In order to relate our model to realistic systems, we consider the double- well trap potential 



used in the experiment of a single-component BJJ of ®''Rb 



2|, and set the parameters to be 



consistent with this experiment. In this experiment, parameters are as follows. The ratio 



A = NUa/ C^Ja) is estimated as 15 in Ref. 
Since the total-particle number N is 1150 in 



2|, which corresponds to the strong-coupling case. 
2| , the atomic interaction strength normalized 



by the atomic tunneling strength can be obtained as Ua/Ja — 3 x 10~^. We use this value 
for the atomic interaction strength. As for the molecular interaction strength, we suppose 
that the molecular scattering length is the same as the atomic one and that the shape 
of condensate wavefunctions of atoms and molecules are the same. Under this condition 
Ub = Ua/2 from Eq. flB4l) . In addition, in this study we set the total particle number as 
N = NaL + NaR + 2NbL + 2NbR = 2000. 

We next consider the atom- molecule interaction. From the experiment 9| , the atom- 
molecule scattering length of ^^Rb is estimated as aam = — 180 ± 150ao, where is Bohr 
radius, and the ratio of the atom-molecule scattering length and the atomic scattering length 
can be derived as aam/ da — —3.2 ~ 0.3. Based on this value we suppose that the atom- 
molecule interaction Uab to be negative, but treat it as a variable parameter. We will 
compare results with different values of Uab- The negative Uab is well-suited to the internal 
tunneling between internal states because phase separation does not occur. This is different 



from a binary BEC mixture in the \F = 2,mj = 2) and |1, —1) spin states of 
component separation is observed due to the repulsive interspecies interaction 



87 



-Vo, where 



39| 



In order to set the molecular tunneling strength, we suppose that the atomic eigen state 
^aL(aR) and the molecular eigen state ^bL{bB) have almost the same shapes. From the Eq. 
(IBB and = 2m„, J^/Ja = 1/2. 



B. Equations of time evolution 

In order to obtain the ground state and the eigen frequencies corresponding to the ex- 
citation spectra, we derive the time-evolution equations. Using the classical four-mode 
Hamiltonian, we can derive the Hamilton equations of motion describing the dynamics of 
atomic and molecular BECs in a double-well potential as : 



• dHd ■ dHcl , . 

»i,, = -||l, M„ = -|f=^. (7) 



These time evolution equations can also be obtained by applying classical analysis to 
the Heisenberg equations derived from the quantum four-mode Hamiltonian. Heisenberg 
equation and Hamilton equation are related through the canonical commutation relation 



hN^e 



ih and the Poisson bracket {hN,6} = 1. The explicit expression of these equa- 



tions are given in Appendix O 
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C. Equations for ground state 

We now look for stationary solutions of the equations of motion for the particle numbers 
fICip - f lC4p . We can easily find that the relative phases should be in the ground states i.e. 
the atomic relative phase 6aL — OaR = 0, the molecular relative phase 9bL — ObR = 0, and the 
atom-molecule relative phases 26aL(aR) — ObL{bR) = 0, respectively. 

In this study, we investigate the ground states in the presence of the atom-molecule 
internal tunneling in a symmetric double- well potential. From the Hamiltonian ([3]), the 
competition between the tunneling strengths and the interparticle interactions determines 
the ground states. The inter- well tunnelings Ja, Jb lower the energy most when the particle 
populations are equal in two wells. The inter-atomic and inter-molecular repulsive inter- 
actions Ua, Ub act in the same way. In contrast to the above contributions, the attractive 
atom-molecule interaction Uab lowers the energy when the particles localize in one well. As 
discussed later in Sec. IIIIBt the atom-molecule internal tunneling g can act effectively as 
the attractive inter-atomic interaction. This competition will cause the asymmetric ground 
state, which breaks the symmetry of the double-well trap potential. 

In order to look for the ground state with a fixed particle number, we introduce the 
chemical potential fi and the grand canonical energy 



where the total number is defined as = Nai + NaR + 2NhL + 2 A'^/^. Then the ground state 
can be determined from 



(8) 



dK 







dK 



0, 



(9) 



dNaL(aR) 
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or equivalently ( from Eqs. and ([7]) ) 



h9aL{aR) = "/i, hObL(hR) = -"^jJ-. (10) 



From Eq. (|C5])-(|C8D, we obtain 



= M tF^- ^-LUa - N.LUat + 2g^L: (H) 

V ^^aL 

= Ja\h^- NaRUa - N.nUab + 2^7 (12) 

V J^^aR 

-2/X = Jm/^ - a - U,N,L - NaLUab + 9^^, (13) 

-2fi = Jb\l^ - A - UbNba - NaRUab + 9^^. (14) 

V J^^bR V^bR 



These equations determine the stationary states. It is clear that the above equations always 
have a symmetric solution Nai = NaR, N^l = N^r. However, the symmetric solution does 
not always have the lowest energy. We will show this in Sec. Illll from both the linear stability 
analysis and calculating energy. 



D. Excitation spectra 

Solving the linearized Hamilton equations, we obtain the four eigen-frequencies of the 
excitation spectra from the stationary states. We will look at these eigen frequencies to 
investigate the stability of the system. If the excitation frequency u has an imaginary part, 
such stationary state is dynamically unstable, i.e. if the stationary state is perturbed slightly, 
the small-amplitude oscillation exponentially grows in time. 

Our procedure is summarized as follows. We first expand Hd in fluctuations around 
the symmetric stationary state to second order. Next, by performing the canoni- 
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cal tTanshTmation{eaL,0aR,6bL,6bR) (^0o, 0am, 0+, 0- j , and {NaL, NaR, NbL, Nh^) 

Xq, Xam, ! we diagonalize the canonical momentum part of the Hamiltonian. De- 

tails of calculations are given in Appendix [Dl We arrive at the quadratic Hamiltonian 



1 12 , 1 12 



ll2 , ll2 



Hci ^ -00 + ^rAM + + ^r- + Veff [ x_, Xam 



(15) 



The explicit form of Veff is given by 



Veff [X+,X., Xam] ^ gNa^/ N, 



4Ua + Uh- Wab + 



4 + 



2N, 



6X+,6X^]V 



( ~ \ 

5X, 



5X 



AM 



(16) 



where Na {Nb) is the atomic(molecular) particle number in each well at the symmetric sta- 
tionary state, that is, A''^ = NaL{aB)^ = A'feL(6R)- The 2x2 matrix V is defined as 



V 



^ 2^n^niz^{-jl + + («+ + «_) ui,) , 2f]„z_ [aUi + + 2a^u:,) 



,(17) 



where Jl = JJK + Ua, Jt = Jb/Nb + and 



= Ub + 



gNa 



2NbVNb 



u: 



ab 



- Uab. 



(18) 



Using this quadratic Hamltonian, we obtain the linearized Hamilton equations. Eliminating 
the phase variables, we arrive at 



12 



-2V 



^ 6X^ ^ 



(19) 
(20) 



We then assume the normal mode solutions, 6X±. oc e='=*'^*, SXam e='=*'^*. Equation 
immediately gives one eigen frequency: 



(^^m)' = 2^?iV, (4t/„ + + 4?7; 



a6J 



(21) 



The other two eigen frequencies can be obtained by diagonalizing the coefficient matrix of 
Eq. m- 



2 (AJ: + CJ^) + ABU:, 



±JA {{AJ^, + Cr,) + 2BUl,Y - 16 {AC - 52) (jeje _ (^eji)^ (22) 



where we have defined the coefficients A, B and C as A = NaJa + 2gNa\/Ni,, B = gNa^/Nl 
and C = NbJb + \gNay/Nb respectively. We note that from Eq. (1D4I) . X^m and X± can be 
expressed in terms of number variables as 



Xam 



N, - 2X„ 



10^/gNa^M' 

2(a+-a_) V2i2±Z± 



(23) 
(24) 



From Eq. ( p3|) . we see that XyiM mode represents the oscillation between atomic and molec- 
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ular BECs. Therefore, ojam represents the internal Josephson frequency between atomic- 
molecular states. Since one can easily show > and a_ < 0, Eq. ( 124|) clearly shows 
that represents the out-of-phase inter-well motion, in which the atoms and molecules 
oscillate inversely, whereas X_ represents the in-phase inter-well motion, in which the atoms 
and molecules oscillate in the same direction. For the parameters defined in Sec. HIl ^+{'^-) 
represents to the out-of-phase (in-phase) mode. In more general, the eigen vectors of uj± 
modes are the linear combination of in-phase and out-of-phase motions. In addition, the cor- 
responding frequencies uj± are reduced to the Josephson frequencies in a single- component 
case in the limit oi g ^ Q and Uab — ^ 0. 

III. PARTICLE-LOCALIZED GROUND STATES INDUCED BY INTERNAL 
ATOM-MOLECULE TUNNELING 

When the atom-molecule interaction Uab and the atom-molecule internal tunneling g are 
small, the ground state is symmetric, i.e. the particle populations in two wells are equal to 
each other. In this section, we will show that the atom-molecule internal tunneling induces 
the particle-localized ground state. This transition from the non-localized ground state to 
the localized one is signaled by the dynamical instability of the in-phase mode. In what 
follows, we investigate the dynamical stability of the original symmetric ground state, by 
using the excitation spectra derived in the previous section. After the stability analysis, we 
investigate the stationary states and show the bifurcation of the symmetric stationary state 
to the asymmetric ones. The cause of particle-localization will be discussed in Sec. IIIIBI 
and IIII CI In Sec. IlllCl and IIIID[ we also discuss the possibility of the reentrant transition. 

Here, we explain the parameters of the particle interactions. We set the atomic interaction 
strength Ua and the molecular interaction strength Uh as described in Sec. [TTl throughout 
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this section. In what follows, we set the atom-molecule interaction strength as Uab/Ja = 
—2.3 X 10"^ (except the stability diagram Fig. |8] and |9] varying Uab and g), whose absolute 
value is slightly smaller than Ua- 



A. Particle localization transition 

First, we determine the atom- molecule energy difference A, which we use in this section. 
The stationary states are determined by solving Eq. f|TT]) - f|T4|) . In the absence of the atom- 
molecule internal tunneling there only exists the symmetric stationary state, which is the 
ground state. The A-dependence of particle populations in the limit (7 — )■ is shown in 
Fig. [H From Fig. [1] each condensate has a few hundreds of particles so that classical 
analysis introduced in Sec. Ill Al is appropriate. Hereafter we choose the atom-molecule 
energy difference as A/ = 3 in order that the atomic and molecular particle numbers are 
almost the same. 




FIG. 1: A-dependence of particle populations at symmetric stationary states. □(+) represents 



In Fig. 121 we investigate the (7- dependence of particle populations at the symmetric sta- 
tionary state. From this figure we conclude that the particle populations are large enough 
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FIG. 2: flf-dependence of particle populations in the symmetric stationary states. □(+) represents 
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FIG. 3: ^-dependence of excitation spectra of the symmetric stationary states. 
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FIG. 4: fl'-dependence of imaginary part and real part of huj^ at symmetric stationary states. 
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for applying the mean-field approximation in a wide range of atom-molecule internal tun- 
neling g. We also find that the atomic populations in the ground states grows, by increasing 
the atom-molecule internal tunneling strength. In the symmetric stationary state, where 
'^OaLiaR) " ObL{bR) = 0, Na = NaL{aR) and N^, = NhL{bR), the internal tunneling term in the 
Hamiltonian ([3]) is reduced to be —AgNay/T^. Because the order of Na is larger than that of 
Nfy, the symmetric stationary state tends to lower the total energy by increasing A^^ rather 
than Nf, in the large g region. 
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FIG. 7: (^-dependence of total energy at symmetric and asymmetric stationary states. The inset 
is energy difference between symmetric and asymmetric stationary states. Eg {Ea) represents the 
total energy of symmetric(asymmetric) stationary state. 



xlO 


-2 




2.0 




2.1 






-o - 


2.2 








■2.3 




■2.4 




1 2 3 4 5 



FIG. 8: The stability phase diagram for the symmetric stationary state at A = 3Ja- The black 
line represents Huj- = 0. 



Next, we investigate the dynamical stability of the symmetric stationary state by looking 
at the excitation frequencies. Fig. [3] is the excitation spectra. w+ and uam are always real 
and close to each other in the large g region. On the other hand, as shown in Fig. [3l uj- goes 
to zero at the finite atom-molecule internal tunneling g. As shown in Fig. UJ the imaginary 
part of a;_ emerges at the same value of g, while the other modes are still dynamically stable. 
This fact indicates the occurrence of symmetry-breaking phase transition. 
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In order to confirm the appearance of tlie particle-localized ground state, we investigate 
the particle populations in the stationary state by solving Eqs. ( [TT]) - (fT4|) . Figs. [5] and [6] 
show the atomic and molecular populations in the stationary solutions. These represent the 
bifurcation of the populations, which means the appearance of the new stationary states 
induced by the atom-molecule internal tunneling. In these new stationary states, the popu- 
lations of atoms and molecules are localized in the same well, which means the breaking of 
the left-right symmetry of a double-well potential. The value of g at the bifurcation point is 
the same as that of the point, where dynamical instability occurs. Furthermore, we compare 
the total energies of the symmetric and asymmetric ground states. Fig. [7] shows that the 
total energy of asymmetric state is lower than that of the symmetric state, which means the 
alteration of the ground state. 

Finally, we investigate the stability of symmetric stationary states by varying Uab and g. 
The stability diagram of the symmetric stationary state is presented in Fig. [HI From this 
figure, the large g and negative Uab induce the asymmetric ground state. 



B. The effective attractive interaction 



The effective inter-atomic attractive interaction mediated by molecular bosons is often 
discussed in the context of BCS-BEC crossover in a Fermi gas with Feshbach resonance 



using the two-channel model 



We discuss the same type of attractive interaction in the 



four mode model, assuming the simplest case Jb = Ub = Uab = 0. 



In this simple case, we can solve Eqs. (fT3!) and (fT4l) for ^jNbL{bR) as. 



■\J NbL{bR) = g 



NaL{aR) 
A -2/i' 



(25) 
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By using this in the grand canonical energy, we obtain 



K = -2JaVNaLNaR+ -Ua (iV'i + N^r) ' (N^L + iVafl) , 



(26) 



where 



(27) 



A - 2n' 



This clearly shows that the effect of the atom-molecule tunneling modifies the inter-atomic 
interaction Ua to the effective interaction Ua- From Eq. ([251), is clear that A > 2/i always. 
Therefore, the contribution from the atom-molecule tunneling is always attractive in the case 

Jb = Ub = Uab = 0. 

In order to investigate the transition from the symmetric to asymmetric state, we write 



This clearly shows that the ground state is determined by the competition between the 
inter- well tunneling J a and the effective interaction Ua- The transition from the symmetric 
solution {x = 0) to the asymmetric solution {x 7^ 0) occurs when the sign of the coefficient 
of the quadratic term changes from positive to negative. More explicitly, the asymmetric 
state become the ground state when Ja + NaUa < 0. By using (l25l) . this condition is written 



NaL = Na{l+x), NaR = Na{l-X), 



(28) 



and expand K in x. We obtain 



2NaJa + Nlila - 2fiNa + Na ( J, + NaUa) x' + 




(29) 
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as 



Ja + NaUa 



(30) 



From this condition, the atom-molecule tunneling always tend to make the asymmetric 
ground state. This analysis assumed the simple case Ji, = 0,Ub = 0, Ua = 0. One might 
expect that the quantitative results do not change for the general long as Jb, Ub and 

Uab are small. However, in the following sections, we show that the atom-molecule tunneling 
has also the effect creating the symmetric ground state in the general case Jb 7^ 0,Ub 7^ 

0,Uab^O. 

C. The stability condition of the symmetric stationary state 

In this section, we consider the general case Jb 7^ 0, f/;, 7^ 0, Uab 7^ 0. In this case, we 
have not been able to reduce the ground canonical energy in a simple closed form in terms 
atomic populations NaL and NaR. Thus, we use the excitation spectra in order to discuss 
the stability of the symmetric state. 

From Eq. (l22l) . the dynamical instability condition (hujjf' < is reduced to be 

When this inequality is satisfied, fiuj^ mode becomes dynamically unstable, signifying that 
the ground state becomes asymmetric. This condition generalizes Eq. (!30|) to including J^, Ub 
and Uab- The remarkable difference from (l30l) is that the atom-molecule tunneling strength g 
appears in both sides of the equation. This means that the atom-molecule internal tunneling 
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does not only tend to create the asymmetric ground state but also symmetric one. This non- 
monotonic behavior has not been found in the simplest model neglecting J^, Ub, Uab- 

The term including g is gNa/ (2Nby/Nb) in the left hand side, and gj^fW^ in the right 
hand side. The ratio of these terms is N^j {'2Nb), which is the ratio of the numbers of 
atomic-state and molecular-state particles. This is controlled by the atom-molecule energy 
difference A like Fig. [1] as explained in sec. IIII A[ 

The large A tends to increase Na as seen from Fig. [T] Therefore, when A (> 0) is large, 
by increasing g in Eq. flHT]) . the term including g in the left hand side is more enlarged 
than the one in the right hand side. In contrast, when A is small, the term including g in 
the left hand side does not have a significant role in the symmetric-asymmetric transition. 
Therefore, the atom-molecule tunneling tends to create asymmetric ground state as Eq. 

m- 

However, this A-dependence is not the case in the large g region. Since the right hand 
side is quadratic in g, the right hand side of Eq. fl3Tl) is enlarged by g independently to the 
atom-molecule energy difference A in the large g region. In this large g region, Eq. fj3T|) 
reduces to Eq. fISUl) . 

Therefore, when A (> 0) is large, the atom-molecule tunneling has the tendency to create 
the symmetric ground state in the small g region, whereas it tends to create the asymmetric 
ground state in the large g region. The influence of the atom-molecule tunneling on the 
ground state depends on the strength of the atom-molecule tunneling when A (> 0) is large. 
In Sec IIII Al we investigated the small A region. In the next section, we investigate the large 
A region. 
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FIG. 9: The stability phase diagram for the symmetric stationary state at A = 50 Ja- The black 
line represents huj^ = 0. 

D. Reentrant transition 

In this section, we discuss the possibiUty of the reentrant transition, where the ground 
state changes in the order of asymmetric-symmetric-asymmetric by increasing g. The reen- 
trant transition occurs when the positive A and the negative Uab are large. As explained 
in the previous section, when A (> 0) is large, the atom-molecule tunneling tends to create 
the symmetric ground state in the small g region. Therefore, when the negative Uab is large 
enough to create the asymmetric ground state at g = 0, the finite g can cause the transition 
to the symmetric ground state from the asymmetric one. In contrast, in the large g region, 
the atom-molecule tunneling tends to create the asymmetric ground state, and the transi- 
tion from symmetric to asymmetric ground state is possible. In this way, by increasing the 
internal tunneling g at the sufficiently large A, the ground state turns from the asymmetric 
state to the symmetric state, and again, goes to the asymmetric phase. 

In fact, the large A changes the stability phase diagram as Fig. |9l which is quite different 
from Fig. [HI In this figure, around Uab/ Ja = —2.5 x 10^^ at g = 0, the symmetric stationary 
state is unstable, and increasing the internal tunneling g, the symmetric state changes to be 
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stable. Increasing g further, the symmetric state turns to be unstable again. We note that 
asymmetric stationary states exist, when the symmetric sate is unstable. In this region, the 
asymmetric states are the ground states. 

In what follows, we estimate the value of A required to cause the reentrant transition 
at the ground state. From Eq. fl3T|l . the phase boundary between the stable and unstable 
phases is given by 



Ua. = ^-j('^ + Ua] + + (32) 



If the reentrant transition does not occur, the stability phase diagram appears as Fig. |8l 
where the phase boundary is almost straight line. On the contrary, in the case that the 
reentrant transition occurs as in Fig. [9l the phase boundary line has the minimal Uab value. 
Therefore, from the condition dUab/dg = 0, we can derive the condition for the reentrant 
transition. We find that 



(7™„ = -i= {Ja + NaUa) - {Jf, + N,U,) , (33) 



where we define gmin as g at the minimal Uab point. The condition for the reentrant transition 
is given by gmin > 0. In the weak coupling limit NaUa <^ Ja and NbUb ^ Jb, the condition 
gmin > is reduced to be Na/Nb > 16Jb/Ja, and in the strong coupling limit NaUa ^ Ja and 
NbUb S> Jb, the condition for the reentrant transition is Na/Ni, > A^/U|JUa. In this paper, 
we take NUa/ Ja = NUb/Jb = 60 following the discussion in Sec. HIl Therefore, we are in 
the strong coupling limit. Using the parameters in Sec. HIl Ub/Ua = 1/2, and Na/Nb > 2\/2. 
Using this criterion, A > 407^ is needed to cause the reentrant transition from Fig. [TOl 
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FIG. 10: A-dependence of Na/N^ at the symmetric stationary state(triangle points). The solid 
line represents the Na/Ni, = 2\/2. 

We now examine the experimental possibility realizing this large detuning A. First, we 
estimate the value of Ja/h. Within a two mode model, the Josephson frequency in the single 
component case[l| is hwj = 2JaVl + A. In the single BJJ experiment [21], the Josephson 
frequency is estimated as uj = 40 (ms)~^, and A = 15 as explained in Sec. [Tll Using these 
values, we find Ja/^ — 20s~^. Using this value, we estimate the value of A = 50 J^, which 
we use in Fig. [91 This gives 



A 



50 X 20s-^ = IkHz. 



(34) 



We compare this value with the experimental value of Feshbach resonance using ^^Rb 19 |. 
In this experiment, the energy difference between the open-channel(closed-channel), which 
corresponds to the atomic (molecular) state, is Afi {B — Bres), where A/i is the difference of 
magnetic moments between these states, and B is the strength of the magnetic field. Bres is 
the strength of the magnetic field at the Feshbach resonance point. In this experiment, A/x 



is estimated as A/i = 27Th x 111 kHz/G . In this experiment, B ends typically 50mG away 
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from the Feshbach resonance. Using this value, A/i x [B — Bres) — 27r x 5kHz. This is 
larger than the estimated value given in 



IV. SUMMARY 

We investigated how the atom-molecule internal tunneling changes the ground state of 
atom-molecule BECs in a double-well potential. From the linear stability analysis, we 
showed that the atom-molecule internal tunneling induces the particle-localized ground state 
through dynamical instability. This is quite different from the single component BJJ be- 
cause the tunneling terms between BECs tends to prevent localizations in a single component 

BJJ a]]. 

As explained in Sec. IIII CI the particle localization is caused by the fact that the inter- 
atom-molecule tunneling behaves like inter-atomic attractive interaction effectively. We 
showed that this effective interaction is always attractive in the absence of Jb, Ub and Uab- 
This is the same type effective interaction with that in the two-channel model often used in 
the study of BEC-BCS crossover in a Fermi gas with Feshbach resonance J 



However, the situation can be quite different in the general case that Jb ^ 0,Ub ^ 
and Uab 7^ 0. We pointed out the possibility of the reentrant transition, which cannot be 
understood in terms of the effective attractive interaction. In the large A (> 0) region, the 
ground state changes from localized to non-localized, and again to localized, with increasing 
the atom- molecule internal tunneling. From this result, we pointed out the possibility that 
the atom-molecule internal tunneling exhibits the rich physics undiscovered in the treatment 
of the simple two-channel model neglecting the atom-molecule interaction and inter-molecule 
interaction. 

Next, we point out that quantum fluctuations do not prevent the particle localization. In 
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order to consider the effect of quantum fluctuations, we performed the exact diagonahzation 



of the Hamiltonian ([2])[40||. From this full-quantum treatment, we conclude that the ground 
state becomes the superposition of the particle-localized states in the left and right well. 

Finally, we note that the reentrant transition cannot occur in a binary BEC mixture. 
By replacing the internal tunneling term in the (j2]) with (h^^ciL + ^lSI + b^RO^R + ^i?^^/? j ? we 
have the Hamiltonian for a binary BEC mixture. From the same procedure as in Sec. [Til we 
can obtain the equation for a binary BEC mixture similar to Eq. fIST]) . From this equation, 
we can conclude that the reentrant transition is unique to atom-molecule mixture BECs. 
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Appendix A: Dynamical instability and second order phase transition 

In this Appendix, we briefly review the general relation between symmetry breaking 
and dynamical instability. We suppose the classical Hamiltonian having / degrees of 
freedom as if = J2i=i^ + Veff {xi, X2, — - -Xf), where Xi{i = 1,...,/) are the dynami- 
cal variables and pi{i = 1,...,/) are their canonical momentums. The coefficients of ki- 
netic terms have been normalized by scaling the dynamical variables. Expanding this 
effective potential around stationary states to second order in the fluctuations, one ob- 
tains H ^ Y.{t + \ Eij ^^^^i^^i = Ef f + l^x^V^x. Here we defined = 
{6xi, 6x2, ■ ■ ■ Sxf) and Vjj = ff^H /dxidxj. The linearized Hamilton equations are given by. 
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f)- — -— — - V-^ Sr ■ ()r- — — — n- then ^r - — - V'^ Sr ■ <^ — -VSic 

Defining the eigen frequency as u, Xi oc e^*"^*, {i = 1, /), we find that the eigen value of 
V is eqaul to u^. 

It is thus clear that the matrix V is positive definite, if we expand around the ground state. 
Then, if any of eigen values change to be minus at a ground state by varying parameters, 
this state is no longer a ground state. In general, the original ground state becomes a saddle 
point or a local maximum, and the new ground states are bifurcated around the original 
one. 

Consequently, the second order phase transition of Veff corresponds to the fact that an 
excitation spectrum hw becomes purely imaginary number. A purely imaginary u represents 
a slipping off from the original ground state to the symmetry-breaking ones. Since V is 
the symmetric matrix, the eigenvalue is always real, and thus in this second order phase 
transition of a ground state, an excitation spectra becomes purely imaginary number. 

Appendix B: Parameters 

The parameters are defined as follows : 



J^-= 



iL 



2mi 



2m,- 



-V^ + K.t r 



iL 



Ui = gi / dr\^iL\^ = gi / dr\^iji 



Uab = gab j rfr|$„Rn$feR|2 = gab j dr\^aL\'^\^ 

g = \ j dr^lL^aL'^aL = A J dr<^lj^<^aR'^aR, 



A = 6 dr\%L\^ + El - 2El = 6 / dr\^ 



2mi 



-V' + K.t,(r) 



■bR\ 



Et - 2EI 



(Bl) 
(B2) 
(B3) 
(B4) 
(B5) 
(B6) 
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where i = a{b) represents atomic (molecular) BEC modes, and L(R) expresses the left(right) 
well respectively. 

Appendix C: time-evolution equations 

The exlicit forms of the Hamilton equations Q-dZ]) follows : 



hN^L = 


-2Ja^/NaLNaRSm( 


fiaR 


- Oai) + '^gNaL^/NbL sin(2e,L 


-ebL) 


(CI) 


hNaR = 


-2JaVNaLNaRSm( 


fiaL 


- OaR) + AgNaR\/N^,Rsm{2eaR 


- ObR) 


(C2) 


hNbL = 


-2Jby^NbLNbR sin( 


dbR - 


- 9bL) - 2gNaL^NbL sin(2^„i - 


-ObL) 


(C3) 


hNbR = 
nOaL = 


-2Jby/NbLNbR sin( 

V ^^aL 


dbL - 
Gal] 


- ObR) - 2gNaR^NbR sin(2e,R - 

1 - NaLUa - NbLUab + 2^ ^iVbi 


- GbR) 

COs{29aL - ObL) 


(C4) 
(C5) 



MaR = JaJ^ cosiOaL " ^aij) " N^RUa ' N^RU^b + 2g ^/N^cos{e,R - 29^r) (C6) 

MbL = Jb\^cos{e,R - ObL) - A - N.LUb - N^LUab + cos{2eaL ' Obi) (C7) 

V ^^bL y J^bL 



WbR = Jbj^ COsiObL - ObR) - A - NbRUb - NaRUab + cos(2^„2 - ^6i?)(C8) 

V J^^bR yJ^bR 
Appendix D: Canonical Transformation 

The relative phases in the ground state are 9aL{bL) - OaR{bR) = 0,29aL(aR) - ObL{bR) = 0. 
Expanding cosines around these zero phases as cos 9 1 — 16'^, we obtain the quadratic form 
in the phase variables. Therefore, the classical Hamiltonian can be expanded to second order 
in phase fluctuations around the symmetric stationary state. Furthermore, we diagonalize 
the Hamiltonian about the phase fluctuations. As a result, one of the eigen value is zero, 
and therefore, the number of degrees of freedom decreases by one. We avoid this problem 
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by introducing a fictitious parameter a, and in the last of the calculations, we set a — > 0. 
After these procedures, we obtain the Hamiltonian as 



H,i ~ a(t)l + -f/0iM + n+Z+(t)l + + Veff (iVaL, NaR, N^L, N^r) , (Dl) 

where 

5 

fi± = NaJa + NbJb + -gNaVNb 

±ly^4(iV,J, - N^JkY + 12{NaJa - NbJb)gNa^i, + 25g^N^Nb, (D2) 

and Z± = {2al + 2)~\ where a± = (fi± - 2NbJb - gNay/K) / {2gNa^b)- We defined 
the notations as 0o = \OaL + l^'a/j + 6bL + ^'feij, 0aa/ = -26aL - 26aR + ObL + ^^feR and 
= a±9aL — ci±6aR — ^bL + ^6_R- <?^'o represents the whole increase of phases keeping the 
relative phases constant, 0± are the inter- well oscillation modes, and (pAM is the oscillation 
between the atomic and molecular states. Veff is 

Veff = -2JaVNaLNaR " 2JbV NbLNbR + A{NbL + iVfci?) + Y^N^^ + ^'^.) + Y^^'^ + ^'r) 
+ UabiNaLNbL + N^RNbR) - 2g [NaLV^+ NaR^/^R] . (D3) 
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We denote the canonical conjugate variables with (po, <P+y 'P-y 'Pam as Xj(i = 0, +, —, AM). 
These are related with the particle numbers as 
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(D4) 

where ^ = (a+ — Xq represents the increase of whole particle number, X± is the 

inter well oscillation mode, and Xam is the oscillation between the atomic and molecular 
states. The poisson brackets are {Xi,(j)j} = iSij = 0, +, —, AM), and therefore these 
are canonical conjugate variables. We then rescale (po, (l)±, (pAM as (po = \/2oL(pQ, (pAM = 
AM, (p+ = -\/2^+^+0+5 0- = \/2n7Zr0_. Corresponding canonical transfor- 
mation for the coordinate variables are Xq = Xq/ \/2a, Xam = Xam / V gNa\/Nh, X+ = 
X+ / ^/2^^^Z^, X_ = X„/ it is easy to see that the poisson brackets are maintained 
as = = 6ij,{i,j = 0,+,—,AM). Therefore the above transformation is 

the canonical transformation. As a result of this procedure, the a dependence of the coeffi- 
cient of (po move to that of Xq. By setting the fictitious parameter a — )■ and eliminating 
the degrees Xq relating to global phase rotation, the degrees of the inter-well and internal 
tunnelings are decoupled in K//. Then, we finally arrive at the Hamiltonian ( !T5|) and (fT6|) . 
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Appendix E: Linearized Hamilton equations 

The linerarized Hamilton equations are MXj = dHd/dcpi = (pi, where i = 0, AM, ±, and 
dXo 

a {Ua + m - AUl,) SXo - V2^ {-2Ua + 2U^ + SWJ SXam- (El) 

dVeff 
QXam 

{-2Ua + 2W, + 3f/:j 5Xo - 2C (4t/, + U', + Wl,) 6Xam (E2) 

dVeff 
dX± 

41]±Z± («| J: + + 2«±f/:,) 6Xi 

4v/fi+fi_Z+Z_ (- J: + J,^ + (a+ + a_) t/^,) (E3) 

Setting the fictitious parameter a — )■ 0, the contribution from the degrees Xq, 0o relating to 
global phase rotation is eliminated. 



[1] S. Raghavan, A. Smerzi, S. Fantoni, and S. R. Shenoy, Phys. Rev. A 59, 620 (1999). 

[2] M. Albiez, R. Gati, J. Foiling, S. Hunsmann, M. Cristiani, and M. K. Oberthaler, Phys. Rev. 

Lett. 95, 010402 (2005). 
[3] C. Weiss and N. Teichmann, Phys. Rev. Lett. 100, 140408 (2008). 
[4] V. S. Shchesnovich and M. Trippenbach, Phys. Rev. A 78, 023611 (2008). 
[5] D. Witthaut, F. Trimborn, and S. Wimberger, Phys. Rev. Lett. 101, 200402 (2008). 
[6] E. Timmermans, P. Tommasini, R. Cote, M. Hussein, and A. Kerman, Phys. Rev. Lett. 83, 

2691 (1999). 



Ham = 



H± = 



32 



[7] Guang-Ri Jin, C. K. Kim, and K. Nahm, Phys. Rev. A 72, 045602 (2005). 

[8] G. Santos, A. Tonel, A. Foerster, and J. Links, Phys. Rev. A 73, 023609 (2006). 

[9] R. Wynar, R. S. Freeland, D. J. Han, C. Ryu, and D. J. Heinzen, Science 287, 1016 (2000). 
[10] E. A. Donley, N. R. Claussen, S. T. Thompson, and C. E. Wieman, Nature 417, 529 (2002). 
[11] M. W. Zwierlein, C. A. Stan, C. H. Schunck, S. M. F. Raupach, S. Gupta, Z. Hadzibabic, and 

W. Ketterle, Phys. Rev. Lett. 91, 250401 (2003). 
[12] S. DiiiT, T. Volz, A. Marte, and G. Rempe, Phys. Rev. Lett. 92, 020406 (2004). 
[13] K. Winkler, G. Thalhammer, M. Theis, H. Ritsch, R. Grimm, and H. Denschlag, Phys. Rev. 

Lett. 95, 063202 (2005). 
[14] M. Mackie, R. Kowalski, and J. Javanainen, Phys. Rev. Lett. 84, 3803 (1999). 
[15] H. Y. Ling, H. Pu, and B. Seaman, Phys. Rev. Lett. 93, 250403 (2004). 
[16] A. P. Itin and S. Watanabe, Phys. Rev. Lett. 99, 223903 (2007). 
[17] K. Bergmann, H. Theuer, and B. W. Shore, Rev. Mod. Phys. 70, 1003 (1998). 
[18] C. Ryu, X. D. E. Yesilada, A. M. Dudarev, S. Wan, Q. Niu, and D. J. Heinzen, arXivxond- 
mat/ 0508201 (2005). 

[19] N. Syassen, D. M. Bauer, M. Lettner, D. Dietze, T. Volz, S. Diirr, and G. Rempe, Phys. Rev. 

Lett. 99, 033201 (2007). 
[20] P. D. Drummond, K. V. Kheruntsyan, and H. He, Phys. Rev. Lett. 81, 3055 (1998). 
[21] D. J. Heinzen, R. Wynar, P. D. Drummond, and K. V. Kheruntsyan, Phys. Rev. Lett. 84, 

5029 (2000). 

[22] A. Vardi, V. A. Yurovsky, and J. R. Anglin, Phys. Rev. A 64, 063611 (2001). 
[23] T. Miyakawa and P. Meystre, Phys. Rev. A 71, 033624 (2005). 
[24] M. W. Jack and H. Pu, Phys. Rev. A 72, 063625 (2005). 



33 



[25] T. Miyakawa and P. Meystre, Phys. Rev. A 74, 043615 (2006). 

[26] Leo Radzihovsky and Jae Park, Phys. Rev. Lett. 92, 160402 (2004). 

[27] M. W. J. Romans, R. A. Duine, Subir Sachdev, and H. T. C. Stoof, Phys. Rev. Lett. 93, 
020405 (2004). 

[28] M. J. Bhaseen, A. O. Silver, M. Hohenadler, and B. D. Simons, Phys. Rev. Lett. 103, 265302 
(2009). 

[29] V. G. Rousseau and P. J. H. Denteneer, Phys. Rev. A 77, 013609 (2008). 
[30] V. G. Rousseau and P. J. H. Denteneer, Phys. Rev. Lett. 102, 015301 (2009). 
[31] S. Ashhab and C. Lobo, Phys. Rev. A 66, 013609 (2002). 

[32] C. Wang, P. G. Kevrekidis, N. Whitaker, and B. A. Malomed, Physica D 237, 2922 (2008). 
[33] L L Satija, R. Balakrishnan, P. Naudus, J. Heward, M. Edwards, and C. W. Clark, Phys. 

Rev. A 79, 033616 (2009). 
[34] B. Julia-Diaz, M. Guilleumas, M. Lewenstein, A. Polls, and A. Sanpera, Phys. Rev. A 80, 

023616 (2009). 

[35] R. Kanamoto, H. Saito, and M. Ueda, Phys. Rev. Lett. 94, 090404 (2005). 
[36] P. Zih, B. Oles, M. Trippenbach, and K. Sacha, Phys. Rev. A 78, 023620 (2008). 
[37] P. Zih, J. Chwedehczuk, B. Oles, K. Sacha, and M. Trippenbach, Europhys. Lett. 83, 64007 
(2008). 

[38] Y. Ohashi and A. Griffin, Phys. Rev. Lett. 89, 130402 (2002). 

[39] D. S. Hall, M. R. Matthews, J. R. Ensher, C. E. Wieman, and E. A. Cornell, Phys. Rev. Lett. 
81, 1539 (1998). 

[40] A. Motohashi and T. Nikuni, J. Low Temp. Phys. 158, 72 (2010). 

34 



